Ground States of the Sherrington-Kirkpatrick Spin Glass with Levy Bonds 



O 



C/3 



I 

o 
o 



> 
o 
vn 
in 

o 



Stefan Boettcher^'El 

^Physics Department, Emory University, Atlanta, Georgia 30322, USA 

Ground states of Ising spin glasses on fully connected graphs are studied for a broadly distributed 
bond family. In particular, bonds J distributed according to a Levy distribution P{J) oc 1/|J|^^", 
|J| > 1, are investigated for a range of powers a. The results are compared with those for the 
Sherrington-Kirkpatrick (SK) model, where bonds are Gaussian distributed. In particular, we deter- 
mine the variation of the ground state energy densities with a, their finite-size corrections, measure 
their fluctuations, and analyze the local field distribution. We find that the energies themselves at 
infinite system size attain universally the Parisi-energy of the SK as long as the second moment 
of P (J) exists (q > 2), and compare favorably with recent one-step replica symmetry breaking 
predictions well below a = 2. At and just below a — 2, the simulations deviate significantly from 
theoretical expectations. The finite-size investigation reveals that the corrections exponent uj decays 
from the SK value ljsk ~ | already well above a — 2, at which point it reaches a minimum. This 
result is justified with a speculative calculation of a random energy model with Levy bonds. The 
exponent p that describes the variations of the ground state energy fluctuations with system size 
decays monotonically from its SK value over the entire range of a and apparently vanishes at a = 1. 

PACS numbers: 75.10.Nr , 02.60.Pn , 05.50.-|-q 



I. INTRODUCTION 

The mean-field spin glass, in particular, the 
Sherrington-Kirkpatrick model (SK) pj] provides the 
most thorough and tantalizing insights into the nature 
of frustrated and disordered systems ^ . The applica- 
tions of this model, and the techniques that have been 
developed to dissect it, have dramatically expanded since 
its inception, and pervade many areas of science 0, 0- 
[Tol |. Yet, even for the SK model, many essential aspects 
still have to be revealed. In particular, finite size correc- 
tions to the mean-field solutions have not been worked 
out, and existing conjectures appear to be inconsistent or 
disagree with numerical predictions [Tll - [l8| . These ques- 
tions are not merely academic but seem to indicate an 
incomplete understanding in how finite-dimensional spin 
glasses, as introduced by Edwards and Anderson [19| . 
approach the large-dimensional limit [l^, US] • 

The study of spin glasses with a power-law (Levy) bond 
distribution has been advocated in Ref. [2l| on physical 
grounds, concerning the properties of the RKKY cou- 
plings between magnetic sites in the dilute limit of glassy 
alloys. In fact, it thus may constitute a more "physical" 
mean-field limit compared to the typical, mathematically 
more tractable, Gaussian bonds used in SK. One could 
speculate to whether power-law bonds may actually over- 
come the discrepancies between finite-dimensional spin 
glasses and their mean-field limit. While power-law 
bonds do not seem to affect the phenomenology of the 
droplet model proposed for low-dimensional lattices, the 
corresponding (replica symmetric) mean-field theory in 
Ref. [21] shows much weaker replica symmetry breaking 
effects at low temperatures than SK, which is more in line 



with many numerical and experimental results in finite 
dimensions. An in-depth study of the low-temperature 
properties is pertinent as Levy spin glasses have received 
much renewed theoretical attention recently j22| - |25| . In 
particular, Ref. J24!] provides a number of theoretical pre- 
dictions for the ground state energy density both, at the 
replica symmetric (RS) and the one-step replica symme- 
try breaking (IRSB) level, to compare with. 

In this paper, we probe mean-field spin glasses for a 
one-parameter family of bond distributions with power- 
law tails to explore how this may affect familiar prop- 
erties, such as the distribution of ground state energies, 
its characteristic width, and the finite-size scaling cor- 
rections to the energy in the thermodynamic limit. In 
particular, we consider bonds J distributed according to 
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for a range of powers a. (In contrast to most theoretical 
work that is limited to specific regimes of a, we do not 
rescale the bonds with system size N in our simulations; 
proper densities for the various regimes are defined in 
Secini) From a conceptual standpoint, the bond distri- 
bution in Eq. ([T|) is interesting because it provides a grad- 
ual interpolation between those distributions possessing 
a second moment (for a > 2) and those that don't, i.e., 
where that moment diverges with the system size N. For 
instance, singular behavior for the ground state energy 
has been obtained near a = 1 and 2 in Ref. [l^l, at least 
at the replica symmetric level. While we expect the be- 
havior for a > 2 to be similar to SK, it is interesting to 
see how this limit is approached and how scaling expo- 
nents may change with a. The extreme limit of bonds 
well-separated in size have been studied in Refs. [26l, |27}. 

In our simulations, we use extremal optimization 
(EO) [H, (ill, a local search heuristic which has been 
used successfully to obtain ground state approximations 
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for mean-field and finite-dimensional spin glasses with 
bimodal and Gaussian bond distributions [13, [l8| . 
Broadly distributed bonds create a very heterogeneous 
configuration space, which provides a significant chal- 
lenge for any local search heuristic, and considerable 
computational resources had to be expanded to obtain 
sufficiently accurate results. Combined with the desire 
to sample an entire a-family of models, such obstacles 
have limited the achievable system sizes, which may at 
times call into question whether true asymptotic behav- 
ior has been reached. At their face value, the EO results 
are consistent with RSB predictions for the ground state 
energies except near a = 2, where EO appears to pro- 
vide a finite value. Both, the exponent for finite-size 
corrections w and for the width of energy fiuctuations 
p, exhibits an interesting variation with a at T = 0, 
most dramatically near a — 2. In fact, due to their 
higher-order nature, these variations in finite-size effects 
are already noticeable below a = 4, well before the dis- 
appearance of the second moment in the bond distri- 
bution. That such finite-size effects may exhibit non- 
universal (i.e., bond distribution dependent) behavior 
has already been observed for mean-field spin glasses on 
sparse graphs [H, [s^] ■ 

This paper is organized as follows: In the next sec- 
tion, we describe the model and our conventions for the 
determination of the energy densities. In Sec. IIIIl we 
briefly describe the EO-heuristic used to obtain the nu- 
merical results, which are subsequently discussed in de- 
tail in Sec. IIVI In the Appendix, we outline our specula- 
tive (and somewhat lengthy) calculation for the random 
energy model (REM) [3l|, |32| , which we use in the dis- 
cussion of the numerical results. 



II. SPIN GLASSES WITH POWER-LAW BONDS 

The Hamiltonian for a fully connected mean-field spin 
glasses is defined as 

^ = jfT.Yl J^^o<^^^j^ (2) 

1=1 j=i+l 

where we formally included a normalization factor A/" 
to make the energy extensive, in light of the fact that 
the bonds J^j- are taken from the unrescaled density in 
Eq. ([l]). As we are here exclusively interested in proper- 
ties of the ground state energy density, it is convenient 
to simply set A/" = 1 and accept the fact that the pu- 
tative ground state energies E found in our simulations 
for instances with the Hamiltonian in Eq. ([2|) are neither 
extensive nor properly adjusted to the characteristic cou- 
pling strength Jq. We obtain proper energy densities, in- 
dependent of system size N , in the relevant regimes of a 
via 



Note that in Eq. ([3]) we have chosen to ignore, for all 
a > 2, the usual scaling with the second moment of 
P(J), i.e., instead of having a unit moment we have 
j2 — ^j2^ — which fails to exist for a < 2. This 

choice allows us to consider the special case a — 2 more 
closely, but to compare with the familiar result from SK, 
esK = —0.76321 . . . [sl, Is^], we will have to take this 
extra factor into account. 



III. FINDING GROUND STATES WITH 
EXTREMAL OPTIMIZATION 

In our numerical investigations here, we use the Ex- 
tremal Optimization heuristic (EO) [28ll35j . in particular, 
an adaptation of EO developed previously for SK ■ 
Due to the potentially wide distribution of bonds (in par- 
ticular, for small a), we pre-process the bond matrix Ji,j 
in a manner discussed in more detail in Ref. 36]: Any 
spin (Ti, 1 < i < A^, is determined, subject to the state of 
spin Uji, if 

1 ^ 

< maxi<j<Ar{|J^j|} EE J,jv, (4) 

such that the bond Ji,ji is satisfied in the ground state. 
This dependency allows us to eliminate the ith column 
and row from the bond matrix by compounding the re- 
maining bonds Jij^j' according to 

Jj'J ^ Jj'.] + sign {Ji J,) J,^j (foraUjT^j') 

and similarly for Jjji , to preserve the symmetry of the 
bond matrix. The ground state energy E^^ of this 
reduced bond matrix for N — I spins gives the energy of 
the original system via 

Eq -Eg ~\JiJ,\. 

Of course, this reduction procedure can be applied re- 
cursively until there are no more spins i that satisfies 
Eq. Q. 

Clearly, this reduction procedure is most effective for 
small a; for instance, at a = 1/2, about half of all spins 
can be traced out in this way. The resulting problem is 
not only drastically smaller in size (considering the expo- 
nentially growing cost for determining the ground state 
exactly!), but the bond matrix is also much more homoge- 
neous for the subsequent application of the EO heuristic. 
While the reduction is ineffective for a > 2, even for, say, 
a = 3/2, where only a few spins get reduced, the elimi- 
nation of those exceedingly dominant bonds can be quite 
helpful for local search with EO. 

The remaining bond matrix is then treated by r-EO as 
outlined in Ref. [13]: A fitness proportional to the (neg- 
ative of) the local field is defined for each spin, and spins 
are chosen for an update with a bias toward spins of low 
fitness as specified by the parameter r. For the system 
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sizes in this paper, a value of r = 1.5 and a sequence 
of 0{N^) update steps for each instance proved most ef- 
fective. While systems with a < 1 are readily reducible, 
and systems with a > 2 are very homogeneous, those al- 
most irreducible, but quite heterogeneous systems with 
1 < a < 2 provide the biggest challenge for EO, requir- 
ing at least ten times more update steps for consistent 
results. Each instance was treated repeatedly with EO, 
each repeat starting from random initial conditions, and 
results were considered consistent when a total of six runs 
reproduced the putative ground state energy. 

IV. DISCUSSION OF THE NUMERICAL 
RESULTS 

We have determined approximate ground states for a 
large number of fully connected graphs for sizes N = 
31, . . . , 255 with bond matrices filled with random bonds 
drawn from the power-law distribution in Eq. ([T]) for val- 
ues ranging over a = 0.9, 1.2, . . . , 3.0 in steps of 0.3, and 
a = 3.9. Extremely large statistics was required to obtain 
converging averages, which ultimately limited the system 
sizes reached. For comparison, we have included earlier 
results for SK [ll,|T3, where sizes of TV = 1023 had been 
obtained. At these finite system sizes, instances reveal- 
ing the characteristics of the thermodynamic limit are 
few and far between, as very large bonds are an essential 
feature of the ensemble for a < 2 but only arise infre- 
quently. Hence, a large number of instances are required 
for converging results. Here we averaged over about 10^ 
at the smaller system sizes and at least 25, 000 for the 
largest sizes, N = 255. 

A. Corrections to scaling 

First, we investigate the average ground state energy 
density (e) and its finite-size corrections to scaling. In 
Figs. Ewe plot these energies in an extrapolation plot as a 
function of inverse system size, 1 /iV^/'^, which is generally 
believed to be the magnitude of scaling corrections in 
the SK. We notice significant deviation from that scaling 
behavior for varying a. For each value of a, we have 
fitted the data to 



A plot of the same data but linearized through the scaling 
in Eq. ([5]) with the exponent uj extracted from those fits 
are also shown in Fig. [1] and the fitted values for w as a 
function of a are displayed in Fig. U) 

B. Ground-state energy fluctuations 

A deeper insight into the subtleties of ground state 
energies is provided by their distribution over the ensem- 
ble of instances. Typically, we plot the PDF as o'-P(e) vs. 



(e— (e))/(T, where cr = y (e^) — (e) is the standard devi- 
ation of the distribution. But for a < 2, we find that the 
PDF has a broad tail for energies below the mean, which 
behaves as P{e) ^ (— e)~"~^ for e — ^ — oo. Hence, (e^) 
and a do not exist. Instead, we define a width via the 
absolute moment (see Ref. [SQl) w = (|e — (e)|) to char- 
acterize the distribution and plot wP{e) vs. (e — {e))/w 
for each a in Figs. [D 

The power-law tails at low energies e —oo in Figs. 
[5] for a < 2 are easy to explain: They are entirely due to 
those rare, large bonds from deep within the bond distri- 
bution in Eq. ([T]), which almost always must be satisfied 
and comple tely dominate the ground state energy when 
they occur [2^ [23| . Accordingly, those tails of the PDF 
decay with the same exponent, 1 -I- a, as Eq. p]). 

The feature of P(e) of greatest interest is the scaling 
of its width. As noted, the standard deviation a does 
not exist for a < 2, but we can instead for all a > 1 
refer to the width derived from the first absolute moment, 
w — (|e — (e)|) , introduced above. It is expected that, 
like cr, the width would decay with system size as 

w - N-P. (6) 

As an example of the significance of this exponent we 
mention that according to Ref. fT2l|, p is related to the 
exponent y (or 9) for domain-wall excitations in the 
large-dimensional limit d — > oo of the Edwards- Anderson 
model [T9II via 

yld=i- p, (7) 

which has led to much consideration recently [l^ [13, l20l . 
[39l - [43j . In Fig. [31 we have plotted the values of w ob- 
tained in preparing Fig. [5] as a function of N for each 
value of a. In reference to Eq. ([6|), we specifically use its 
extrapolated version and plot — In(u') / In(A^) as a func- 
tion of 1/ In(A^), which should extrapolate linearly to the 
thermodynamic value of p at the intercept 1/ In(iV) — > 0. 
It appears that p increases from zero at a < 1 to sat- 
urate at the SK value. Although large uncertainties in 
the precise value of p for each individual a should be 
expected (and possibly non-analyticities or logarithmic 
corrections), the general trend in p appears to be reli- 
able. The SK data provides justification for choosing w 
as the width instead of the more conventional deviation 
a: The extrapolation of w in Fig. |3] leads to identical 
results for a as in Refs. [l^.[l7|. 

C. Exponents as a function of a for 2 < a < 4 

While p appears to rise rapidly but monotonously from 
zero at a = 1 to approach the SK- limit, cj instead has 
a distinct minimum of about u « 0.25 near a = 2. 
For larger a, it approaches the presumed SK-value of 
Lo — 2/3. In turn, in the limit for a — 1~, lo may revert 
to its SK value, although a simple volume-size correction 
to the energy with w = 1 or even exponentially small size 
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Figure 1: Average ground state energy density (e) obtained with EO for various system sizes up to A'^ = 511, for values of a 
between 0.9 and 3.9 in Eq. ([TJ. In eacii panel, the EO data is once plotted as a function of (black squares), the scaling 

projected for SK (corresponding to a — >■ oo), and once linearized with the fitted scaling correction exponent u [a) (blue x). 
While no specific scaling can be identified for the smallest q, the scaling is consistent with SK (linear on this scale) for larger 
values of a, but significant deviations from u) = 2/3 in Eq. ((5]) are observed for intermediate values of a, where cj appears to 
attain a minimum of oj ~ 0.25 at a = 2. The results for uj (a) are also summarized in Fig. 2] 
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Figure 2: Plot of the ground state energy PDF obtained with EO. We plot the data for all values of A'^ in each panel, whereas a 
varies between panels from 0.9 to 3.9. The PDFs appear to reach an asymptotic form quickly with small finite-size effects, which 
are most pronounced for smaller a (and, in fact, are divergent for a. < 1). For a < 2, the tails for e —oo are a power-law 
(dotted lines) with the same exponent as the input bond-distribution P{J) in Eq. ((T]), since those ground state energies are 
dominated by a few large bonds that must be satisfied. For a > 2, the random sum of many small bonds dominates the energy, 
leading to increasingly exponential tails and the PDF becomes similar to that found in SK p^. fl^ . The scaling of the 
width w with system size is discussed in Fig. [3] 



corrections with ^ oo appear conceivable. Although 
both exponents, lu and p, approach the corresponding 
SK-value convincingly for larger values of a, that limit 
is attained in a manner that requires some explanation. 
Even for values of a > 2, where a second moment in 
P( J) already exists, both exponents still deviate signifi- 
cantly from their SK-values. The smallest value beyond 
which one might argue that the SK-limit has been satu- 
rated would be a = 3, but it may even be higher. Our 
data would indicate a steady approach to that limit but 
its system-size limitations certainly could not exclude a 
singular "bend" at a = 3, say. 

We argue that the origin of these anomalous exponents 
for a > 2 can be tied to higher-order differences between 
the moments of a Gaussian and a Levy distribution. In 
particular, for a < 4, the 4th moment of the Levy dis- 



tribution remains divergent. As both exponents refer to 
finite-size effects, i.e., they do not per-se relate to prop- 
erties of the SK (that are universal for 2 < a < 4) in the 
thermodynamic limit, the sensitivity of these exponents 
to such differences is not surprising. In the Appendix, 
we have done a speculative calculation for the finite-size 
scaling corrections in the REM model [3l|, [s^ with Levy 
bonds. The key result, Eq. (f^ . clearly demonstrates 
that at this level there are anomalous scaling exponents 
already for 2 < a < 4, well in qualitative accord with 
our numerical findings in Fig. |4l where we indicated the 
REM result by a dash-dotted line. 
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Figure 3: Extrapolation plot of the width w = {\e ~ (e)|) of 
the ground state energy distributions P{e) in Figs. [2] versus 
system size A'^ for each value of a. Note that ln('u;)/ In(Ai') 
—p for 1 / ln(A'^) — >■ 0. As a reference, we have included the cor- 
responding SK data for w derived from the study in Ref. [ij • 
Theory _39j provides an upper bound of p = ^ that should 
be approached for large a. On the other side, when a drops 
below 1 the width diverges (in the limit of infinitely many 
instances), independent of system size A'^, leading to the con- 
clusion pa<i =0. For increasing a > 1, p seems to increase 
rapidly to saturate soon at the SK limit, see Fig. |3] 



D. Local field distribution at a — 3/2 

We now investigate also the distribution of local fields 
P{h) in the ground state configurations for a = 3/2. 
Instead of parsing out the whole parameter space, we 
focus on a single value of a to optimize statistics. Specif- 
ically, a = 3/2 is chosen, since it is ideally located suf- 
ficiently below the cross-over regime near a = 2 , above 
which the central limit theorem comes into play, and suf- 
ficiently above a = 1, where (numerical and theoretical) 
pathologies arise due to the extreme breadth of the bond 
distribution. 

In Fig.[5]we plot the data obtained for P{h) for a = 3/2 
up to = 200. The function has similar characteristics 
to those observed in other spin glasses 01 j with a near- 
Poissonian shape, but with a much broader tail for larger 
h. Overall, at A'^ = 200 finite-size effects have largely di- 
minished already, with the notable exception near h — 0, 
which in turn harbors the dynamically most relevant in- 
formation contained in P{h). In the ground state con- 
figuration (in which almost all variables have a positive 
local field) the number of variables with near-vanishing 
local field characterize the stability of the state, for which 
the scaling-behavior of P{h) for A^ — > oo and ft- — > holds 
the key. Despite significant curvature for increasing h, it 
seems clear from Fig.[5]that the slope of P{h) is nonethe- 
less linear at the origin, as it is for SK. 

To obtain a closer insight into the scaling of P{Q) itself, 
we plot in Fig. [5] just the values at the origin of Fig. [S] 
as a function of system size A^. It is very hard to get 
well-converged data for larger system sizes, such as those 
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Figure 4: Top panel: Plot of the measured values of the ex- 
ponents ij (from Figs. [1]) and p (from Fig. [3| over the range 
of values for a used in this study. (Lines are added just to 
guide the eye.) For a > 1, lj initially drops towards a mini- 
mum near a = 2 to rise again and approach its SK-value of 
2/3. In turn, p rises monotonically from about zero at a = 1 
to its SK-value, which is which varies only little for a > 3. 
The dash-dotted line corresponds to the naive REM calcula- 
tion, see Eq. (|29p . Bottom panel: Plot of the ground state 
energy densities in the scaling of Eq. (|3]). Black circles de- 
note the extrapolated EO values found in Fig. [T] (connected 
by a dotted line to guide the eye). The line for 1 < a < 2 
corresponds to the RS- and the blue diamonds to the IRSB- 
calculation from Ref. [l^, [l^l, the line for a > 2 provides the 
exact SK-energy esK = —0.76321 . . ., appropriately rescaled. 
The energies found with EO deviate significantly from the 
theoretical values near a = 2, where finite-size corrections 
are also the strongest (or, lj is minimal, see top). 
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Figure 5: Plot of the distribution of local fields P{h) for h > 
only for a range of system sizes A'. (The function is symmet- 
ric, and it is normalized to 1/2 for the positive part shown 
here.) The distribution is nearly linear for ft — >■ 0, although 
higher order terms become more noticeable for increasing h 
than is the case for SK 44] . For larger values of h, we observe 
a much broader tail than for SK, yet, that tail still represents 
an exponential fall-off. From this plot it is not clear whether 
P{h) at /i = remains finite for A'^ — >■ oo, therefore, we study 
the behavior of P{0) more closely in Fig. (6] 
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Figure 6; Plot of P(0) as a function of system size TV. The 
data exhibits scahng over almost a decade, decaying roughly 
as 7V~'''^^, displayed as the full line. For comparison, lines 
for a N~^^^ (dotted line) and A'^~^'^*-decay (dash-dotted line) 
are also plotted. 



available for SK [4J| , but luckily the data exhibits already 
solid scaling starting with > 31. The scaling, with 
an exponent of about « 0.4, indicates that P{0) — >■ in 
the thermodynamic limit but is definitely slower decaying 
than for SK, which falls with 1/Vn 
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VI. APPENDIX: FINITE-SIZE CORRECTIONS 
IN THE LEVY-REM 

We use here the assumption of the random energy 
model (REM) [3l|, [s^ that the spectrum of available 
states are uncorrelated to obtain an estimate for the 
finite-size scaling of the SK model with Levy bonds. This 
is true for the p-spin generalization of SK in the limit of 
p — > c» with Gaussian bonds, but this is clearly not ob- 
vious for Levy bonds. We go even further and assume 
this to hold even for p = 2, the case considered for SK 
in this paper, in order to estimate leading-order scaling 
and finite-size corrections to the ground state energy den- 
sity. A full treatment of the Levy- REM would likely be a 
lengthy exercise but potentially rewarding as interesting 
classes of the extreme-value distribution of ground-state 
energies and of the local field distribution may result. 



A. REM with Gaussian bonds 

To review the REMjH HI, SI] calculation for the 
Hamiltonian of the p-spin model, 
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and, following Ref. Q , calculate the densities of energy- 
levels via 
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assuming in the first line that the energies are uncorre- 
lated: 
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The ensuing Gaussian integral in Eq. ()10|) only depends 
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Of course, no steepest-descent analysis is required here 
to solve this integral: 



V{E) = 



_E_2 

e « 



(14) 



Then, we get for the entropy 

S{E) = lTin{E) ^ln[2'^V{E)] 
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As the entropy may not become negative, vanishing of 
the entropy (-density) defines the ground-state energy 
density 
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Its numerical value, — Vm2 = —0.832555, is plau- 
sible when compared to the Parisi energy, esK = 
-0.763217 ... [11 01. The implicated finite-size correc- 
tion of this result. In [N) /N or uj — 1, of course, does not 
correspond to the SK result ior p — 2, presumed to scale 
with N^'s , But since this result has become entirely in- 
dependent of p > 2, one would hardly expect a better 
agreement. After all, only for p — )■ oo are these energy 
levels sufficiently uncorrelated, as in Eq. (ITTt . to justify 
this approach. The value of our calculation here lies not 
so much in a precise prediction for w but in a plausible 
trend in the function io{a) and its transitions. 



finite value of to while B becomes small in some fashion 
for N ^ oo. In that case, we are merely looking for the 
series expansion of In [/„ (x)] for small values of x: 
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as long as a > 2; for a < 2 there are higher powers of the 
a;"-term in Eq. (I20p from the expansion of the logarithm 
to take into account. There are exceptional cases for 
a = 2,4,...: 



B. REM with Levy Bonds 

We can repeat the above calculation for the p-spin 
Hamiltonian in Eq. ([5]) with a bond distribution of the 
Levy- type. 



P{J) = |i3"|jri-", 
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for some positive B, which will be discussed below. 

Inserting this bond distribution into Eq. (llOp results in 
a density of states V [E) as in Eq. using 
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a. Case a > 4: For a > 4, the irregular term 
in Eq. (E^ becomes irrelevant for the determination of 
ground-state energy density and its corrections. We find 
for ip (t) in Eq. ([T^ to leading orders. 
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with 
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which can be written in terms of special functions to 
facilitate the ensuing analysis: 



fa{x) = iF2(--;-,l--;-- 
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For even a — 2,4,..., both terms in Eq. (pn|) develop 
identical singularities for small a; in a way that the re- 
sulting expression always remains finite: 
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From Eq. it is clear that for the saddle point in 
the thermodynamic limit N ^ 00, B will have to be 
chosen to scale with the system size as to make "ip {t) 
stationary in that limit and to render the energy density 
E/N intensive, i. e., it has to serve to compensate the 
explicit factor of NP~^. We expect that for all values of 
a the saddle point is located at some (possibly complex) 
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for some constant C and with the choice of 

B = 



2a 



We can write the density of states in Eq. (|12|) as 
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Focusing only on a small e-neighborhood in t near the 
saddle-point to = 2i§ (with 1/VN < e < 1), followed 
by the shift t = to + ^ yields [i^ 

=-^[(f)^+o(-^)] 




Hence, for a > 4 there is neither a change in scaling for 
the leading-order calculation for the ground state energy 
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density nor for its finite size correction from those ob- 
tained for the REM with Gaussian bonds in Sec. IVI A[ 
as for p = 2 (or larger) any corrections arising from the 
broader tails remain sub-dominant. Furthermore, the 
pre-factor in the choice of B in Eq. ((25)) ensures that the 
second moment of the bond distribution remains unity, 
( J^) = 1, for all a > 2, such that the ground-state en- 
ergy is also numerically identical to that of the Gaussian 
case. 

b. Case 2 < a < 4; In this case, the irregular term 
in Eq. ([22]) now becomes relevant for the determination 
of the finite-size correction for the ground-state energy 
density and its corrections. With the same choice of B 
as in Eq. (f25l) , we then find for ijj (t) in Eq. (fTS]) to leading 
orders. 
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Following exactly along the lines of Eqs. (|26ll27p . we ob- 
tain 

where now the correction in ^{t) accounts for the next- 
to-leading term, dominating the factor originating from 
the Gaussian saddle-point integral for some {jj > 2) or 
all {p = 2) of this regime. We surmise that to leading or- 
der we retain the ground-state energy from the Gaussian 
case here (as the second moment of the bond distribu- 
tion still exists!), but already in this regime of a we find 
a non-universal effect in terms of the finite-size correc- 
tions [l^. For instance, ignoring the fact that statistical 
independence of the energy levels only holds for p — ^ oo, 
we boldly set p = 2 to extract an approximation for the 
finite-size scaling exponent. 
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While not in great quantitative agreement with the nu- 
merical results for p = 2, this analysis does indeed cap- 
ture the essence of the numerical results to some quali- 
tative satisfaction. 

c. Case a = 2: It seems clear that in this case not 
only the corrections but also the ground state itself will 



pick up some messy form of log-scaling. To this end, 
it suffices to determine the form of B that leaves the 
saddle-point stationary for N oo. From Eqs. (fT8|) and 
expanding (^5)) to sufficient order, we get 
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Even for general complex t, the saddle-point is still de- 
termined via ip' {to) =0. The obtained saddle-point at 



tn 



2NP-^B^ In(iVP-iB) 
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B 



(31) 
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Thus, we have acquired an unusual logarithmic correc- 
tion, already for the leading behavior of the ground state 
energy density. Inserting to in Eq. (|31|) into V (t) in 
Eq. (1201) yields 



V'(io) = - 



1 + 



'in VlniV^ 



(33) 



assuming that any other contribution from the actual 
saddle-point integral only results in much smaller correc- 
tions than the indicated ones, arising from the correc- 
tions in the motion of the saddle-point itself. At p = 2, 
we would therefore predict for the ground state energy 
density. 
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In Vln VN 



\nVN 



(34) 



with the same thermodynamic limit as before, but much 
smaller corrections. Of course, such a scaling is nearly 
impossible to verify numerically. 

d. Case 1 < a < 2; Now, the saddle-point analysis 
changes somewhat, with the integration contour being 
rotated into the complex plane, requiring a more sophis- 
ticated steepest-descent approach [4g|- In our naive ap- 
proach taken here, we find that reasonable solutions for 
Eq persist for a > |, at which point the saddle point 
rotates across the branch-cut on the negative real-axis 
in the complex-^ plane. We leave this calculation as an 
exercise for the reader. 



[1] D. Sherrington and S. Kirkpatrick, Phys. Rev. Lett. 35, theory and beyond (World Scientific, Singapore, 1987). 

1792 (1975). [3] K. H. Fischer and J. A. Hertz, Spm Glasses (Cambridge 

[2] M. Mezard, G. Parisi, and M. A. Virasoro, Spin glass University Press, Cambridge, 1991). 



10 



H. Nishimori, Statistical Physics of Spin Glasses and In- 
formation Processing (Oxford University, Oxford, 2001). [27 
M. Mezard, G. Parisi, and R. Zecchina, Science 297, 812 
(2002). [28 
M. Talagrand, Spm Glasses: Gavity and Mean Field 
Models (Springer, Berlin, 2003). [29 
P. R. Eastham, R. A. Blythe, A. J. Bray, and M. A. 
Moore, Phys. Rev. B 74, 020406(R) (2006). [30 
E. Schneidman, M. J. Berry, R. Segev, and W. Bialek, 
Nature 440, 1007 (2006). [31 
A. Percus, G. Istrate, and C. Moore, Computational [32 
Gomplexity and Statistical Physics (Oxford University [33 
Press, New York, 2006). 
M. Mezard and A. Montanari, Constraint Satisfaction [34 
Networks in Physics and Computation (Oxford Univer- 
sity Press, Oxford, 2006). [35 
J. -P. Bouchaud, F. Krzakala, and O. C. Martin, Phys. 
Rev. B 68, 224404 (2003). [36 
T. Aspelmeier, M. A. Moore, and A. P. Young, Phys. 

Rev. Lett. 90, 127202 (2003). [37 
A. Andreanov, F. Barbieri, and O. C. Martin, Eur. Phys. 
J. B 41, 365 (2004). [38 
S. Boettcher, Eur. Phys. J. B 46, 501 (2005). 
T. Aspelmeier, A. Billoire, E. Marinari, and M. A. Moore, 
J. Phys. A: Math. Theor. 41, 324008 (2008). [39 
M. Palassini, J. Stat. Mech. P10005 (2008). 
S. Boettcher, J. Stat. Mech P07002 (2010). [40 
S. Boettcher, Euro. Phys. J. B 74, 363 (2010). [41 
S. F. Edwards and P. W. Anderson, J. Phys. F 5, 965 [42 
(1975). 

S. Boettcher, Phys. Rev. Lett. 95, 197205 (2005). [43 
P. Cizeau and J. P. Bouchaud, J. Phys. A: Math. Gen. 
26, L187 (1993). [44 
K. Janzen, A. K. Hartmann, and A. Engel, J. Stat. Mech. 
P04006 (2008). [45 
K. Janzen, A. Engel, and M. Mezard, EuroPhys. Lett. 
89, 67002 (2010). [46 
K. Janzen, A. Engel, and M. Mezard, Phys. Rev. E 82, 
021127 (2010). 

I. Neri, F. L. Metz, and D. BoUe, J. Stat. Mech. POlOlO [47 
(2010). 

C. M. Newman and D. L. Stein, Phys. Rev. Lett. 72, 



2286 (1994). 

M. Cieplak, A. Maritan, and J. R. Banavar, Phys. Rev. 
Lett. 72, 2320 (1994). 

S. Boettcher and A. G. Percus, Phys. Rev. Lett. 86, 5211 
(2001). 

A. Hartmann and H. Rieger, eds.. New Optimization Al- 
gorithms m Physics (Wiley- VCH, Berlin, 2004). 

L. Zdeborova and S. Boettcher, J. Stat. Mech. P02020 
(2010). 

B. Derrida, Phys. Rev. Lett. 45, 79 (1980). 

B. Derrida, Phys. Rev. B 24, 2613 (1981). 

R. Oppermann and D. Sherrington, Phys. Rev. Lett. 95, 
197203 (2005). 

R. Oppermann, M. J. Schmidt, and D. Sherrington, 
Phys. Rev. Lett. 98, 127201 (2007). 

S. Boettcher and A. G. Percus, Artificial Intelligence 119, 
275 (2000). 

S. Boettcher and J. Davidheiser, Phys. Rev. B 77, 214432 
(2008). 

S. Boettcher and T. M. Kott, Phys. Rev. B 72, 212408 
(2005). 

W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. 
Flannery, Numerical Recipes in C (Cambridge University 
Press, Cambridge, 1995). 

G. Parisi and T. Rizzo, Phys. Rev. Lett. 101, 117205 
(2008). 

T. Aspelmeier, J. Stat. Mech. P04018 (2008). 
T. Aspelmeier, Phys. Rev. Lett. 100, 117205 (2008). 
G. Parisi and T. Rizzo, J. Phys. A: Math. Theor. 43, 
045001 (2010). 

G. Parisi and T. Rizzo, Phys. Rev. B 79, 134205 
(pages 12) (2009). 

S. Boettcher, H. G. Katzgraber, and D. Sherrington, J. 

Phys. A: Math. Theor. 41, 324007 (2008). 

D. J. Gross and M. Mezard, Nucl. Phys. B 240, 431 

(1984). 

C. M. Bender and S. A. Orszag, Advanced Mathematical 
Methods for Scientists and Engineers (McGraw-Hill, New 
York, 1978). 

The SK code is available in the DEMO section at 
|http://www.physics.emory.edu/faculty/boettcher[ 



